Defining and selecting objectives and performance metrics for oil spill response assessment: A process design integrating analysis and deliberation

This document lays out a framework by which defensible performance metrics for oil spill response can be developed in an analytic-deliberative process that includes a broad range of stakeholders and is informed by high quality scientific knowledge. Performance metrics can be used to: improve oil spill response planning, promote institutional learning post-response, support public communication during and after spills, etc. The framework takes as a starting point the existing “business as usual” approach to response planning and proposes specific activities that can be undertaken to integrate selection of performance metrics into contingency planning efforts. This paper builds on theories and empirical research on public participation in hazard management, typologies of performance metrics, and decision analysis. A core principle of this framework is that performance metrics for oil spill response must be tightly coupled to objectives for oil spill response. Objectives, performance metrics, and methods for measuring need to be selected so that they represent both best available science and appropriate democratic agreement. Using the best available science means that metrics should be measurable, meaningful, and are consistent with previous scientific work. It also means that the measures of metrics (and objectives) selected are justified with evidence, models, or theories. Using the appropriate democratic agreement means that the objectives, metrics, and measures selected adequately represent the interests at risk. It also means that the objectives, metrics, and measures chosen reflect a consensus among interested and affected parties. The integration of performance metrics into oil spill response planning will help ensure plans better reflect public concerns and values, promote learning, and improve spill managers’ communications with the public.